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Abstract 

We present capacity results of the binary-symmetric parallel-relay net- 
work, where there is one source, one destination, and K relays in parallel. 
We show that forwarding relays, where the relays merely transmit their 
received signals, achieve the capacity in two ways: with coded transmis- 
sion at the source and a finite number of relays, or uncoded transmission 
at the source and a sufficiently large number of relays. On the other hand, 
decoding relays, where the relays decode the source message, re-encode, 
and forward it to the destination, achieve the capacity when the number 
of relays is small. 



1 Introduction 

D In this paper, we present capacity results for the binary-symmetric parallel- 
relay (BSPR) network, where a source transmits data to a destination via relays 
(refer to Fig. [1]). 

We show that using a finite number of forwarding relays^ which forward 
their received signals without any decoding and re-encoding, performs arbitrar- 
ily close to the capacity of the network as the number of relays increases. The 
asymptotic capacity results hold even when the source sends uncoded message 
bits. For networks with a small numbei]^ of relays, forwarding relays do not 
achieve the capacity, but decoding relays, where the relays decode the source 
message, re-encode, and forward it to the destination, do achieve the capacity. 

The additive white Gaussian noise (AWGN) parallel-relay network was stud- 
ied in [iHS] (and references therein). It has been shown that using coding at 
the source and no coding at the relays achieves the asymptotic capacity of the 
AWGN parallel-relay network [2] and the non-coherent multiple-input multiple- 
output (MIMO) relay network [1] as the number of relays increases to infinity. 
The source encodes the data and the relays merely scale their received signals 
and forward them. While these results hold only for large AWGN networks and 
have not been proven for the other networks, this paper considers the BSPR 
network and stronger results are obtained. To the best of our knowledge, the 
BSPR network has not previously been investigated. We will show that using 
coded transmission at the source and mere forwarding at the relays achieves 
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Figure 1 : The BSPR network with K relays 



Table 1: Conditions under which various coding schemes achieve the capacity 



Coding schemes 


Delay 


Network size {K + 2) 


Uncoded transmission witli forwarding relays 
Coded transmission with forwarding relays 
Coded transmission with decoding relays 


Two channel uses 
Infinitely long 
Infinitely long 


Infinitely large 
Medium^ to infinitely large 
Small§ 



arbitrarily close to the capacity of the BSPR network with a finite number of 
relays. 

Uncoded transmission seldom achieves the capacities of noisy channels. How- 
ever, it has been shown to be optimal (in terms of distortion measure) in the 
AWGN parallel-relay network with any number of relays, when the source mes- 
sages are Gaussian random variables [S]- This suggests that when the source 
is matched to the channel, uncoded transmission could be optimal for other 
parallel-relay networks. For the BSPR network, we show that when the source 
(which outputs random bits) is matched to the binary channel, uncoded trans- 
mission achieves the capacity asymptotically when the number of relays, K, 
tends to infinity, but is suboptimal when K is small. 

The main observations of the paper are summarized in Table [TJ It gives 
conditions under which different coding schemes achieve the capacity of the 
BSPR network. The delay is defined as the lag between the time a message 
bit is transmitted at the source and the time the message bit is decoded at the 
destination. The observations are deduced from the following theorems derived 
in this paper: Theorems [T] and [2] which give two upper bounds to the capacity 
of the BSPR network. Theorems |3] and |6] which give two achievable rate regions, 
Theorem [7] which gives the capacity for = 1 and ioi K > 1 under certain 
conditions, and Theorems |4] and [5] which give asymptotic capacity results as K 
increases. In some cases where none of the three coding schemes achieve the 
capacity, a hybrid scheme (Theorem ^ proves to be useful. 
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2 Channel Model and Notation 

The BSPR network with K relays is depicted in Fig. [T] The network has one 
source (node S*), K relays (nodes 1, 2, . . . , K), and one destination (node D). 
A message W is observed by the source and is to be communicated to the 
destination. W , U, Vi, Xi, Yi, Ei, Zi, Vi, are binary variables. 

At time t, the channel from the source to the i-th relay is a binary-symmetric 
channel (BSC) given by Vi[t] = U[t] (B Zi[i\, where U[t] is the signal transmitted 
by the source, Vi[t] is the signal received by the i-th relay, Zi[i\ is the random 
channel noise with Pr{Z'i[i] = 1} = p^^i, and © is modulo 2 addition. The 
probability p^^i is also known as the cross-over probability. Without loss of 
generality, we assume that < Ps.i < ^. Similarly, at time t, the channel from 
relay i to the destination is a BSC given by Yi[t] = Xi[t] © Ei[t], where Xi[t] is 
the signal transmitted by relay i, Yi[t\ is the signal received at the destination, 
Ei[t] is the random channel noise with Pr{i?i[t] = 1} = pt^d- Again, we assume 
that < pi^d < 5- We assume that all Zi[t] and Ei[t] are independent. 

Let W be randomly and uniformly chosen from {0, 1, ... , 2"^ — 1}- Consider 
n channel uses from which the destination produces a source estimate W. The 
capacity, C, is the supremum of all achievable rates R at which W can be made 
to satisfy Pe = Pt:{W j^W} <e for any e > 0. 

3 Upper Bounds to Capacity 

We first derive two upper bounds to the capacity. 

Theorem 1. Any achievable rate of the BSPR network must satisfy R < 1. 

Since the source can send at most 1 bit/channel use (through the binary U), 
the capacity is bounded by this rate. Though this capacity upper bound might 
seem loose at first sight, we will show that this bound is achievable (asymptot- 
ically) as K increases. Next, we have a tighter upper bound: 

Theorem 2. Any achievable rate of the BSPR network must satisfy 



for some p{u)p{xi) ■ • ■p{xk)- 

Upper bounds of the type in Theorem [5] are often called cut-set upper 
bounds [6l Theorem 15.10.1]. The first term on the RHS of Q is the max- 
imum rate that information can transfer across the cut separating the source 
from the relays and the destination, and the second term, the cut separating 
the destination from the source and the relays. 




(1) 
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Figure 2: The equivalent point-to-point channel with forwarding relays, where 
Y = (Yi, Fa, ...,Yk) and p*{y\u) defined in Q-® 



4 Lower Bounds to Capacity 

4.1 Coded Transmission with Forwarding Relays 

We first consider relays which do not decode their received signals nor re-encode 
them. 

Definition 1. Relay i is called a forwarding relay if it simply forwards its 
received signals: Xi[t] = Vi[t — 1], Vt. 

Using only forwarding relays, the received signals at the destination can be 
re- written as: 

Y, = U®Z,(BE, = U®N,, te[l,K], (2) 

where Ni — Zi ® Ei. We have dropped the time indices in the equation above 
as it is clear that the destination receives the noisy version of the source's trans- 
mission after two channel uses. We can easily show that 

Vv{Ni = 1} =p,,,i(l -Pi.d) + (1 -Ps,i)Pi,d =Pi, (3) 

which is the cross-over probability for the BSC from U to Yi. 

We have thus turned the network in Fig. [T] with forwarding relays into a 
point-to-point channel from U toY as depicted in Fig.O where Y = (Yi, Y2, . . . , 
Yk) G {0, 1}^ ■ The channel can be completely defined by the transition prob- 
ability 

K 

p*{y\n)^X{p*{y^\ul (4) 

i=l 

where 

p iy^\u) = < ^x, ■ ■ (5) 

I Pi, otherwise 

Theorem 3. Consider the BSPR network depicted in Fig. [7J Rates up to the 
following are achievable: 

Rf = I{U;Yi,Y2,...,Yk), (6) 

for some distribution p{u)Y\f^^p*{yi\u), where p*{-) is defined in ([5]) and 

Proof of Theorem\^ Consider the point-to-point channel in Fig. [5] Theorem [3] 
follows from the channel coding theorem [B] Theorem 7.7.1]. □ 
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Figure 3: Achievable rates (with Pg 0) of coded transmission with forwarding 
relays vs. the number of relays {pi ~ p, Vi) 



Special case: pi — p, \/i ^ [Ij-^l 

The computational complexity of the expression /([/; Fi, I2, • ■ • , Yk) in ^ is 
in the order of 0{2^). For the special case of ~ p,yi ^ [1, K], the expression 
can be evaluated to the following: 

Lemma 1. Consider the BSPR network depicted in Fig. [7] and pi = p, \/i € 
[l,K]. With forwarding relays, rates up to the following are achievable: 

K-l /r- _ -|\ 

i?F = l+Kp\ogp+Kq\ogq-J2 ' I )(gV''-'+9''"V)log(g'p^-'+g^-V), 

(7) 

where q = 1 — p. 

We compute achievable rates of coded transmission with forwarding relays 
for p = 0.1, 0.2, 0.3, and 0.4. Note that for p = 0.5, the channels are randomized 
and the capacity is zero. The results are shown in Fig. [3l At p = 0.1, we only 
need 16 relays or more to achieve 0.9999 bits/channel use. At p = 0.4, we need 
387 relays or more to achieve 0.9999 bits/channel use. 

Note that I{U; Yi, 1^2, ■ • ■ , Yk+i) > I{U ; Fi, F2, • • • , Yk) as the noise in the 
links are independent. So, having more relays in the network increases the 
achievable rate. From numerical computations, we can show that for any p < ^, 
there is a finite K{p) > for which the capacity upper bound of 1 bit/channel use 
(rounded to some significant figures) is achievable with K{p) or more forwarding 
relays. 
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4.2 Uncoded Transmission with Forwarding Relays 

Now, we derive achievable rates for the case where the source sends uncoded 
bits {U = W) and the relays do simple forwarding (X, = Vi). This means the 
source sends one bit of raw information per channel use. i.e., at the rate R = 1. 

Remark 1. In the previous section, we derived different achievable rates for 
networks with different numbers of relays. In this section, we fix the transmission 
rate at 1 bit/channel use (which is a capacity upper bound), and analyze under 
what condition this rate is achievable. 

As forwarding relays are used, we have the equivalent channel in Fig. [2] with 
U = W . At the destination, the received signals are: 



where N.^ = Z,, ® Ei and Y'y{N^ = 1} = as defined in 

Let y = (t/i, 2/2, ■ • • 7 be the received signals at the destination. The 
optimal decision decoding rule, which minimizes the error probability, is: 



Special case: pi ~ p, Vi <E [l,K] 

First, consider the case pi ~ p,\/i £ [1, K]. The decision rule in ([9]) becomes 



(8) 




0. 1fPr{r = y\W = 0} > Pr{r = y\W = 1} 

1, otherwise 



(9) 



(1 -p)°iy)p^-°(y) ^ {i-p)^-°iy^p°(y\ (lo) 







where 0{y) is the number of O's in y. As we can show that < p < ^, the 
optimal decoding function is: 




(11) 



Having defined the decoding function, we derive the error probability. 



Pe = Pr{W ^ W} 




< exp 




(12) 
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where the inequality in ([T^ is due to Hoeffding [71 Theorem 2] if i — p > 0. 
This gives us the foUowing theorem. 

Theorem 4. Consider the BSPR network in Fig.[I\and pi = p < i, Vi G [1, K]. 

Using uncoded transmission at the source and forwarding relays, the asymptotic 
capacity of 1 bit/channel is achievable with a sufficiently large number of relays. 

Proof of Theorem^ By sending uncoded bits at the rate 1 bits/channel use, we 
know from that the error probabiHty can be bounded by Pg < exp {—K6), 
where (5 = 2 (i — p) > 0. So, for any < p < ^ and e > 0, we can select 
K > I In i such that Pe < e. Since 1 bit/channel use is an upper bound to the 
capacity, we have Theorem 21 □ 

General case: possibly different pi, 1 < i < K 

For the general case where not all pi are equal, the decoding rule in pT|) is 
not optimal. However, we can modify the received signals at the destination 
and still use the decoding rule in to obtain asymptotic capacity results. 

Theorem 5. Consider the BSPR network depicted in Fig. [II We use uncoded 
transmission at the source and forwarding relays. Let a subset of M relays be 
A4 = {mi, 7712, • • ■ , fni\j} C [1, if] and let Pmax(m) — max pm ■ If there exists 
an Ai for each K such that 

l-^l Q -PMAX(A^)j ^ oo as K^oo, (13) 

then the asymptotic capacity of 1 bit/channel use is achievable with a sufficiently 
large number of relays. 

The proof of the above theorem follows from Theorem 21 and is omitted 
because of space limitations. 

Remark 2. The condition in (|13p is not unreasonable as long as when the 
number of relays increases, the number of "bad" channels (with cross-over prob- 
abilities Pi close to ^) can be kept at or below a certain fraction of K. A trivial 
example of a network satisfying this condition is one in which as K increases, the 
maximum cross-over probability is unchanged at some pMAX([i,i4']) = Pconst < \ - 



4.3 Coded Transmission with Decoding Relays 

In this section, we investigate if better results can be obtained if we let the relays 
decode the source messages, re-encode, and forward them to the destination. We 
now state the rate achievable with decoding at some relays. 

Theorem 6. Consider the BSPR network depicted in Fig. [II Rates up to the 
following are achievable: 



Pd = min | {i(C/; K„. ) : V777, e } , ^ I{X^^ ; J | 



(14) 
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Figure 4: Cut-set upper bound and achievable rates with coding at the source, 
Ps = 0.05, pd = 0.3 



for some A4 ~ {mi, . . . , mj\/} C [1,/^], and some distribution p{u)Y[iLiP{^mi\u) 

piXmi )p{Xm2 )■■■ P{XmM ) I\f=l Pi.ym, \Xm,)- 

Sketch of Proof for Theorem\^ The first term on the RHS of ^ is the 
rate at which all relays in M can decode the source message, and the second 
term, the rate at which the destination can decode the messages from the relays 
M.. The complete proof is omitted because of space limitations. 

Special case: pg i = p^ and pi ^ = p^, Vi e [1, K] 

Since the uniform input distribution is optimal for the BSC, setting U and 
Xmij yrui e Al, to be independently and uniformly distributed simultaneously 
maximizes all the mutual information terms in (jl4p . This means the mutual 
information terms in (1141) are evaluated as follows: 



/([/, Kn,) = H{V^^) - H{V^^\U) = 1 - (15) 

M M M 

^/(X„,.;y™J = ^(1 - H{prn^^d)) = M -Y,H{p,n,,d)- (16) 
i—1 i—1 i—1 

When ps^i = Ps, Vi, we have 1 — H{ps,i) = 1 — H{psj), "ii,]- So, selecting 
any will not affect min {1 — Hips^mi)} hi p^ . In addition, adding more 

relays into the set M can never decrease as H{pmi,d) < 1- Hence, it is 
always optimal to set A4 = [Ij^^^]- Doing this, the rate in Theorem [5] for the 
case where ps,j: = Ps and pi^d = Pd, Vi 6 [1, K] becomes 

Ru = min{l - H{ps), K{1 - H{pd))}. (17) 

Now, we compare the achievable rates of coded transmission with forward- 
ing relays and with decoding relays to the cut-set upper bound. Fig. [3] shows 
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achievable rates with the fohowing parameter values: ps = 0.05, pd = 0.3. De- 
coding relays achieve a higher transmission rate compared to forwarding relays 
when the number of relays is small, but lower when the number of relays in- 
creases. From (fT7)l . we see that when K > ilg(p°) ; the achievable rate region 
of decoding relays is fixed at i? < \ — H{ps) < 1, which is sub-optimal when K 
grows. 

Decoding relays achieve the capacity under certain conditions 

From Fig.m we see that decoding relays achieve the capacity when 1 < < 
6. Here we characterize the exact conditions for which decoding relays achieve 
the capacity. 

Theorem 7. Consider the BSPR network depicted in Fig. [H The capacity is 
known for the following conditions: 

1. If K=l, then the capacity is 

C= max min {/([/; Fi),/(Xi;ri)}. (18) 

p(u)p{xi) 



2. If K>1, and if 

K 



Vmax/(Xj; Y,) < max/([/; 1/,), S [l,K], (19) 



then the capacity is 

K 



C ^Ym&^I{X,-Yi). (20) 
Proof. From Theorem [21 the cut-set upper bound is 

R< max min {/([/; Fi,..., Fif), V/(X,;y,)| ■ 

P{u)p{xi)---p{xk) I J 

From Theorem [6l taking M. — the achievable rate region of decoding 

relays is 

R< max WL\n{{l{U]V^) :\/i\,y" I{X,-Yi)\ . 

P{u)p(xi)---p(xk} I I- J ~^ J 

Obviously, when K = 1, the two regions match. 

For A' > 1, if (|19p is satisfied, the achievable rate region of decoding relays 
reduces to i^. Since I{U; Vi,..., Vk) > I{U; V^), Mi, we have 

K 

maxI{U; Vi,V2 . . . , Vk) > V niax/(X,; F,), (21) 

p(") pi^i) 

t—i 

and the upper bound also reduces to (pil)) . □ 
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Remark 3. Note that condition (|19p means that the sum of capacities of all K 
channels from the relays to the destination is smaller than the capacity of the 
channel from the source to each relay. This condition is likely to hold for small 
K and when the channels from the relays to the destination are noisy. As the 
LHS is the sum of mutual information terms for K channels, the condition is 
unlikely to hold for large K . 



4.4 A Hybrid Coding Scheme 

Using coded transmission and having only the first M, M < K, oi the re- 
lays forwarding, we can achieve rates up to R-p = /([/; Yi, ■ • ■ , ^m)- Note 
that using more relays always increases i?F- However, using forwarding relays, 
the noise from the source-to-relays links propagates to the relays-to-destination 
links. This can be rectified by having these M relays decoding and re-encoding 
the source messages. This increases the rate at which the destination can decode 
to 'YldLi ^i) ^ I(U\ Yi, Y2, . . . , Ym) — Rf- However, forcing these relays 



to decode adds an additional constraint of 1 — _ff max ,,■ on the rate. 

\i<i<Ar ' J 

We propose a hybrid coding scheme in which some relays decode and re- 
encode the messages, and the rest of the relays forward their received signals. 
Denote the set of decoding relays by 2? and the set of forwarding relays by 
T = {1,2, . . . , K}\'D. Since all relays in the set V need to decode the messages, 

the rate is constrained hy 1 — H i max ps i). As all relays in V fully decode the 

\^ev 'J 

source message and re-encode, we can think of the BSPR network as a point- 
to-point MIMO channel from {U,Xv) to {Yi,Y2, . . . ,Yk), where U and Xi, 
for all i £ V, are statistically independent. The destination node can decode 
the messages at the rate I{U, Xv;Yi,Y2, . . . ,Yk) = I{U;Yjr) + I{Xt);Yv) = 
I{U ; Yjr) + J2 Yi)- So, we have the following theorem: 

Theorem 8. Consider the BSPR network depicted in Fig. [II Rates up to the 
following are achievable: 

Rh = Ii-H (maxPs,^) , I{U; Y^) + ^ (l - H{p, 

for any PC {1,2,..., K} and T = {1,2, . . . , K} \ V, where H [ maxps 

\iev '7 

if |2?| = 0, and p(u) is uniform. 

Determining the optimal set of I? is a hard combinatorial problem. A rule 
of thumb is to include relays with low ps^i in V, and relays with high ps^i in J-. 

Fig. [5] shows rates achievable using the hybrid scheme, all forwarding relays, 
and only decoding relays for a BSPR network with K = 8 relays, ps^i = 
and pi^d = 0.3 for all i G [1,-ftr]. We vary the number of relays to be included 
in the set of decoding relays V. Setting all relays to perform forwarding, we 
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Figure 5: Comparing the hybrid coding scheme to the other coding schemes and 
the cut-set upper bound, K — 8, Ps,i — pt^d = 0.3, Vi G [1,^^] 



achieve Rp = 0.52 (i.e., the hybrid scheme when \T>\ = 0). Using only decoding 
relays, we achieve Rd — 0.62 when six of the eight relays perform decoding 
and re-encoding (and the rest of the relays are unused). Using a combination 
of forwarding and decoding relays, we can achieve a significantly higher rate of 
i?H = 0.71 using four decoding relays and four forwarding relays. For each 
the optimal relay selection is done by the brute force search. 



5 Reflection 

The first three schemes discussed in this paper are capable of achieving the 
capacity of the BSPR network under different conditions, as summarized in 
Table [H 

With coded transmission, decoding relays achieve the capacities of networks 
with one relay, and networks with more relays if the sum of capacities of all the 
channels from the relays to the destination is smaller than the capacity of the 
channel from the source to each relay (this condition is likely to hold only when 
the number of relays is small). 

With coded transmission, forwarding relays achieve 1 bit/channel use (rounded 
to some significant figures) for networks with more than a certain number of 
relays. We showed this by numerical calculations in Fig. [3l 

Using coded transmission, a sufficiently long code length is required to drive 
the error probability to zero. This necessarily incurs a large delay. With un- 
coded transmission, on the other hand, decoding is almost "instantaneous" - 
the destination can decode the source bit after two channel uses. With un- 
coded transmission, message bits are sent at 1 bits/channel use (capacity upper 
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bound). To drive the error probability to zero, however, a sufficiently large 
number of relays is required. 

When neither decoding relays nor forwarding relays achieve the capacity 
upper bound, we proposed a hybrid scheme that can achieve rates significantly 
higher than those achievable using only forwarding or only decoding relays. 
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